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Our  Goals  for  this  Tutorial 


After  attending  the  tutorial,  participants  should  be  able  to: 

1 .  Describe  differences  in  system  of  systems  (SoS)  types  that  are 
relevant  to  making  organizational  and  governance  decisions 

2.  Describe  the  organizational  implications  of  SoS  participation 

3.  Describe  the  complexity  and  associated  challenges  organizations  are 
faced  with  in  an  SoS  context 

4.  Summarize  methods  that  support  organizations  in  the  effective 
analysis  of  their  SoS  contexts 
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Who  are  you?  What  are  your  expectations? 


Engineering  Technicai  Lead? 


Portfoiio  Manager? 


Program  Manager? 
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Terminology 


f  ^ 

Governance 

means  by  which  an  enterprise  secures  the  availability  of 
capabilities  for  its  use  when  and  where  it  needs  them, 
including  the  decision  making  authorities  and  rules  by  which 

decisions  are  made 

V _ ) 


Management 

process  of  designing  and  maintaining  an 
environment  in  which  individuals,  working 
together  in  groups,  efficiently  accomplish 
selected  aims  (e.g.,  functions  of  planning, 
organizing,  staffing,  leading  and  controlling) 


Each  has 
organizational 
implications 

_ _ _ J 


Source  for  management  and  organization:  Weihrich  and  Koontz,  2005 


SoS  Organizational  Implications  Tutorial 

Carne^e  Mellon  October  2009  4 

”  ©  2009  Carnegie  Mellon  University 


Software  Engineering  Institute 


Galbraith  STAR  Model  to  Structure  Discussions 
of  Organizational  Issues 


We  will  come  back 
to  various  aspects 
of  this  model  as  a 
framework  for 
talking  about 
organizational 
issues 


Adapted  from  Designing  Compiex  Organizations,  Jay  Galbraith,  Addison-Wesley,  1973. 
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Agenda 


Basics  of  Systems  of  Systems 

•  Perspectives  of  SoS  Participants 

•  SoS  Types  and  Characteristics 

Organizational  Implications  of  Systems  of  Systems 

Responding  to  Organizational  Implications  in  Systems  of  Systems 

Summary 
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Agenda 


Basics  of  Systems  of  Systems 

•  Perspectives  of  SoS  Participants 

•  SoS  Types  and  Characteristics 

Organizational  Implications  of  Systems  of  Systems 

Responding  to  Organizational  Implications  in  Systems  of  Systems 

Summary 
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What  are  Systems  of  Systems? 
Health  IT  Systems  Example 


A  collaboration  among 
technical  systems  and 
organizational  (people) 
systems... 


...in  relation  to 
some  use 


...within  a  changing, 
unpredictable  context 
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What  are  Systems  of  Systems? 

Coalition  Forces  in  Operationai  Context  Example 


f 

A  collaboration  among 
technical  systems  and 
organizational  (people) 
systems... 


a  /  /  /  ^ 


V 


...in  relation  to 
some  use 


...within  a  changing, 
unpredictable  context 
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What  are  Systems  of  Systems? 
Wildland  Fire  Management  Example 


f 

A  collaboration  among 
technical  systems  and 
organizational  (people) 
systems... 


V 


...in  relation  to 
some  use 


...within  a  changing, 
unpredictable  context 


y 
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Multiple  Perspectives  on  System  of  Systems  -1 

An  SoS  is  a  collection  of  integrated  and  interoperable  hardware  and 
software  entities  providing  capabilities  that  fulfill  specific  functional  and 
operational  needs 


r 

I 

L 


But... systems  of  systems  are  more  than 
interoperating  hardware  and  software  systems 
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Multiple  Perspectives  on  System  of  Systems  -2 


An  SoS  is  a  collection  of  people  and  organizational  entities  involved 
in  acquiring  and  composing  “systems  of  systems”  that  provide 
capabilities  to  fulfill  specified  functional  and  operational  needs 


r 


V, 


Development/ 
Acquisition  View 


Development  staff, 
acquisition  personnel 
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Multiple  Perspectives  on  System  of  Systems  -3 


users 


An  SoS  provides  capabilities 

that  enable  a  collection  of 
operational  users  to  achieve  the 
effects  they  need  to  meet  their 
business/mission  goals 

•  Evolves  to  enable  dynamically 
changing  operational  effects 
within  the  operational  user’s 
context  of  use 

•  Is  likely  to  use  technical  and 
organizational  assets  outside  of 
the  original  design  context 

Operational  Effects/ 
Users  View 


V, 
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V, 


Key  Point:  Systems  of  Systems 
Interrelationships 


Resuit  from 


The  people,  organizations, 
and  interrelationships 
associated  with  building, 
acquiring,  fielding,  and 
^  evolving  systems  of  systems 


The  composition  of  capabilities 
with  users  and  operational 
processes  that  achieves 
desired  operational  effects  for  a 
particular  context  of  use 


Aggregation  of  systems, 
hardware  or  software 
components,  and  other 
devices  to  provide 
operational  capability 
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Key  Point:  Systems  of  Systems  Involve  Social 
AND  Technical  Networks 


Systems  of  systems  involve  understanding  the  networks  of  social  and 
technical  systems 

•  Paying  insufficient  attention  to  the  social  systems  in  which  technical  systems 
operate  is  a  common  failure  pattern 

•  Social  systems  are  open  and  non-deterministic  in  nature  and  require  different 
approaches  than  many  technical  systems 
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Agenda 


Basics  of  Systems  of  Systems 
•  Perspectives  of  SoS  Participants 

^  •  SoS  Types  and  Characteristics 

Organizational  Implications  of  Systems  of  Systems 

Responding  to  Organizational  Implications  in  Systems  of  Systems 

Summary 
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Understanding  the  Relationships  Implied  by  the 
SoS  Perspectives 


Software  Engineering  Institute 
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Relationship  Characteristics  of  Systems  of 
Systems 


stakeholder  volatility 
Stakeholder  diversity 

Stakeholder  autonomy 

Diversity  of  governance 
frameworks 

Centralization  of  control 

Flexibility/adaptability  of  I 
governance  frameworks 

Coherence  of  incentives 


Degree  of  emergence  of  capabilities 
Volatility  of  demand 
Variety  of  demand 

Context(s)  of 
use 


Constituent  diversity  Volatility  of  composition 

Constituent  volatility  Range  of  capability  provided 

Independent  evolution  of  constituents 
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Example  Context:  Wildland  Fire  Management  (WFM) 


To  manage  wildland  fires,  complex  decisions  need  to  be  made  quickly 
over  the  course  of  a  wildland  fire  event 

•  Failure  to  make  informed  decisions  can  result  in  loss  of  life,  homes,  and 
habitat 

•  Decision  makers  rely  on  information  from  numerous  existing  systems 
grouped  into  a  dozen  application  areas  (e.g.,  fire  behavior,  weather,  smoke, 
economic  and  risk  analysis,  fuels  management) 

-  Limited  integration  of  existing  systems  and  data  sources,  but  users 
increasingly  need  them  integrated 

-  Systems  independently  developed  by  different  groups  using  different 
software  languages,  platforms,  architectures,  and  design  assumptions 

Interoperation  of  science  models,  systems,  people,  and  governmental 
organizations  is  rapidly  expanding  the  science  of  wildland  fire 
management 
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Characteristics:  Stakehoider  Relationships  -1 


low 


Stakeholder  volatility 


A 


low 


stakeholder  autonomy 


i 


high 


WFM:  dynamic  relationships  among  stakeholders  due  to  increased  number, 
magnitude,  and  impact  of  fires.  Each  fire  event  has  new  set  of  players. 


high 


WFM:  each  agency  and  level  of  government  has  own  priorities,  stakeholders, 
and  funding 


low 


Diversity  of  governance  frameworks 


A 


high 


WFM:  each  agency  and  level  of  government  has  its  own  framework 
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Characteristics:  Stakehoider  Relationships  -2 


low 


Centralization  of  control 

- k - 


WFM:  no  single  entity  in  charge;  collaboration  attempted  through  interagency 
working  groups 


high 


Flexibility/adaptability  of  governance  frameworks 

low ^ ^ - 


WFM:  limited  -  organizations  with  no  history  of  quick  changes 


high 


low 


Coherence  of  incentives 

— i - 


high 


WFM:  limited  -  each  organization  has  own  priorities  and  incentives 
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Characteristics:  Goals/Purpose  Reiationships 


Degree  of  emergence  of  capabilities 


low 


i 


high 


WFM:  no  single  system  provides  all  (or  the  majority)  of  capabilities  needed  to 
respond  to  a  fire  event 


low 


< 


Volatility  of  demand 


WFM:  each  fire  event  changes  its  scale,  scope,  and  behavior  during  the  course 
of  the  event 


high 


Variety  of  demand 


lOW' 


i 


high 


WFM:  each  fire  event  is  different  in  scale  and  scope  as  well  as  behavior 
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Characteristics:  Constituent  Reiationships  -1 


low 


low 


Constituent  diversity 


i 


Constituent  volatility 


high 


WFM:  wide  range  of  types  of  systems  with  varying  user  interfaces  and 
capabilities 


high 


WFM:  plethora  of  software  systems  and  data  available  with  new  systems 
continually  made  available 


low 


Volatility  of  composition 


i 


high 


WFM:  each  fire  event  requires  potentially  a  different  set  of  systems  and  data 
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Characteristics:  Constituent  Reiationships  -2 


low 


Range  of  capability  provided 


WFM:  most  of  the  systems  are  designed  for  a  narrow  range  of  demand 
situations 


high 


low 


Independent  evolution  of  constituents 


i 


high 


WFM:  uncoordinated  releases  of  systems 
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Different  SoS  will  have  Different  Characteristics 


System  of  Systems  A  System  of  Systems  B 


Even  though  A  and  B  are  both  systems  of  systems,  given  their 
characteristics,  they  would  not  be  governed  in  the  same  way 
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Discussion  Exercise  -1 


Characterize  a  system  of  systems  that  you  are  aware  of  along  the  5 
dimensions  listed  below  and  on  the  next  slide.  For  each  dimension, 

•  Provide  a  brief  description  of  the  dimension  as  it  applies  to  your  SoS 

•  Mark  where  on  the  slider  bar  you  wouid  place  your  SoS 

Pair  up  with  someone  involved  in  a  different  system  of  systems. 

Discuss  how  similar  and  different  your  situations  are  based  on  these  5 
dimensions. 

Stakeholder  volatility:  how  often  do  the  stakeholders  change?  how  much  change? 
low  high 

SoS: 


Centralization  of  control:  is  there  a  strong  single  executive  or  decentralized 
federated  control? 


low 


high 


SoS: 
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Discussion  Exercise  -2 


Coherence  of  incentives:  are  all  stakeholders  striving  for  the  same  collective 
good?  or  are  some  stakeholders  incentivized  to  satisfy  their  requirements  to 
the  exclusion  of  anyone  else? 

low  high 

SoS: 


low 


Volatility  of  demand:  how  often  and  to  what  degree  do  the  situations  the  SoS 
responds  to  change,  especially  within  the  timeframe  of  the  situations? 

<  — .  -> 


high 


SoS: 


low 


Volatility  of  composition:  is  there  a  single  way  to  build  the  desired  capability, 
or  are  there  multiple  (or  changing)  ways  to  assemble  the  constituent  systems? 


SoS: 


high 
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Patterns  of  Relationship  Characteristics 


Patterns  are  emerging  that  allow  summarizing  different  profiles  of 
relationship  and  other  characteristics 

US  DoD  has  proposed  a  set  that  provide  a  working  framework  of 
patterns 
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Types  of  System  of  Systems 


Focus  for  this  tutorial 

i 

i - - \ 


Directed 

Acknowledged 

Collaborative 

Virtual 

Management 

authority 

Centrally  managed 

One  stakeholder 
has  dominance 

A  designated 
manager  and 
resources 

One  stakeholder 
given  dominance 

Central  stakeholders 
collectively  decide  how 
to  provide  or  deny 
service 

Relatively  few 
dominant  stakeholders 

No  central  authority 

Many  stakeholders, 
none  dominant 

SoS  purpose 

Systems  are 
integrated  and 
built  to  fulfill 
specific  purposes 

Recognized 

objectives 

Changes  negotiated 
between  the  SoS 
and  the  constituent 
systems 

System  constituents 
voluntarily  agree  to 
fulfill  central  purposes 

No  centrally  agreed 
purpose; 
large-scale 
behavior  emerges 
from  constituent 
systems  able  to 
integrate 

Independence 
of  constituent 
systems 

None 

Retain  independent 
ownership 

Retain  independent 
ownership 

Retain  independent 
ownership 

Source  of  SoS  types:  DoD  System  Engineering  Guide  for  System  of  Systems  Engineering  (Version  1 ,  August  2008) 
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Software  Engineering  Institute 


Using  Relationship  Characteristics  to  Profiie 
Different  SoS  Types 


A  more  robust  profiling  of  an  SoS  pattern  would  look  at  all  relationship 
characteristics 

For  this  tutorial,  we  will  focus  on  this  subset 

•  Stakeholder  volatility 

•  Centralization  of  control 

•  Coherence  of  incentives 

•  Volatility  of  demand 

•  Volatility  of  composition 

Profiles  do  not  concentrate  on  what  is  possible;  they  concentrate  on 
what  is  common 

We  do  not  expect  that  all  SoS  of  a  certain  type  will  have  all  of  their 
characteristics  falling  within  the  boundaries  we  have  set 
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Notional  Relationships  Profile:  Directed  SoS 


Stakehoider  voiatiiity:  degree  to  which  stakeholders  are  different,  and  frequency  with  which 
stakeholders  change 


Centralization  of  control:  degree  of  centralization  of  decision  and  implementation  authority 


Coherence  of  incentives:  degree  to  which  stakeholders  are  incentivized  toward  the  SoS 
goal  vs.  local  goals 


Volatility  of  demand:  frequency  of  scope  of  changes  in  context  across  situations  and  within 


Volatility  of  composition:  degree  and  frequency  of  change  in  the  way(s)  that  a  desired 
capability  is  composed 
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Notional  Relationships  Profile:  Acknowledged  SoS 


Stakeholder  volatility:  degree  to  which  stakeholders  are  different,  and  frequency  with  which 
stakeholders  change 


Centraiization  of  controi:  degree  of  centralization  of  decision  and  implementation  authority 


Coherence  of  incentives:  degree  to  which  stakeholders  are  incentivized  toward  the  SoS 
goal  vs.  local  goals 


low 


< 


Voiatiiity  of  demand:  frequency  of  scope  of  changes  in  context  across  situations  and  within 
a  single  situation 


> 


high 


Voiatiiity  of  composition:  degree  and  frequency  of  change  in  the  way(s)  that  a  desired 
capability  is  composed 
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Notional  Relationships  Profile:  Collaborative  SoS 


Stakehoider  voiatiiity:  degree  to  which  stakeholders  are  different,  and  frequency  with  which 
stakeholders  change 


Centralization  of  control:  degree  of  centralization  of  decision  and  implementation  authority 


Coherence  of  incentives:  degree  to  which  stakeholders  are  incentivized  toward  the  SoS 
goal  vs.  local  goals 


low 


< 


Volatility  of  demand:  frequency  of  scope  of  changes  in  context  across  situations  and  within 
a  single  situation 


Volatility  of  composition:  degree  and  frequency  of  change  in  the  way(s)  that  a  desired 
capability  is  composed 
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Relationships  Profile:  Wildland  Fire  Management 


Stakeholder  volatility:  degree  to  which  stakeholders  are  different,  and  frequency  with  which 
stakeholders  change 


Centralization  of  control:  degree  of  centralization  of  decision  and  implementation  authority 


Coherence  of  incentives:  degree  to  which  stakeholders  are  incentivized  toward  the  SoS 
goal  vs.  local  goals 


Volatility  of  demand:  frequency  of  scope  of  changes  in  context  across  situations  and  within 
a  sinole  situation 


Volatility  of  composition:  degree  and  frequency  of  change  in  the  way(s)  that  a  desired 


Key  Points  -1 


There  are  four  major  types  of  SoS  patterns  identified  by  the  US  DoD  that 
are  useful  for  profiling  SoS  types 

•  Directed 

•  Acknowledged 

•  Collaborative 

•  Virtual 

Relationship  characteristics  are  useful  for  creating  these  profiles  of  SoS 

•  Relationships  among  stakeholders 

•  Relationships  among  goals  and  purpose 

•  Relationships  among  constituent  systems 

Different  SoS  types  exhibit  different  relationship  characteristics  profiles 

Understanding  SoS  characteristics  profiles  helps  to  understand  the 
implications  of  the  different  types  of  SoS 
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Key  Points  -2 


Directed  SoS 


Is  most  similar  to  traditional  systems 


Acknowledged  SoS 


Are  more  prevalent  in  SoS  situations 
with  less  demand  and  compositional 
volatility 

Still  show  centralization  of  authority, 
but  weaker  than  a  Directed  SoS,  due 
to  independent  ownership  and 
evolution  of  the  constituent  systems 

Have  lower  coherence  of  incentives 
and  higher  volatility/diversity  of 
stakeholders  than  Directed  SoS 


Collaborative  SoS 


Are  more  prevalent  in  more  volatile 
demand  and  compositional  situations 

Are  decentralized  in  terms  of  authority, 
with  situational  authority  granted  to 
“leaders”  of  different  elements 

Are  especially  challenging  because  of 
the  tendency  toward  low  coherence  of 
incentives 

Have  the  fewest  successful 
governance  and  management  patterns 
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Agenda 


Basics  of  Systems  of  Systems 

•  Perspectives  of  SoS  Participants 

•  SoS  Types  and  Characteristics 

^  Organizational  Implications  of  Systems  of  Systems 

Responding  to  Organizational  Implications  in  Systems  of  Systems 
Summary 
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Trends  that  are  Affecting  Today’s  Organizations 


Industrial  Age 
Emphasis 

Post-Modern 

Emphasis 

Value  creation  via 
heavy  industry 
and  physical 
products 

Value  creation  via 
ideas,  knowledge, 
intellect,  innovation 

Manufacturing 

Services 

Products 

consumed 

Experiences 

consumed 

Possession  and 
ownership 

Connections  and 
relationships 

Tangible  value 

Intangible  value 

Implications 

•  Development  of  new  business 
models — e.g.,  Google,  eBay,  online 
insurance  sales  and  claims 
processing 

•  Appearance  of  new  communities — 
e.g.,  blogs,  online  journals,  open 
source  community  production 

•  Acceleration  of  competitive 
pressures — faster  innovation 
cycles,  lower  half-life  of  products 
and  services,  and  faster 
commoditization  of  intelligent 
products 

•  Relationship-based  vs.  ownership- 
based  assets — requires  more 
nimble  business  strategies 
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Responding  to  an  Increasingly  Turbulent, 
Post-Modern  World 


Customers  and  users  need  more  specialized  solutions  in  ever-shorter  time 
frames,  continuously  adapted  to  their  changing  and  evolving  situations 

Suppliers  and  capabilities  have  to  become  more  flexible  to  respond  to 
unanticipated  demand  r 


Product-Based 


Users  want  products  with 
features  and  functions 
that  can  be  provided  in  a 
way  that  is  unaffected  by 
how  they  are  used 


Solution-Based 


Users  want  integrated 
soiutions  of  products 
and  services  that  are 
customized  to  their 
context,  but  in  a  way  that 
can  be  specified 
beforehand 


Requires  a 
fundamental  shift 


User  Experience- 
Based 


Users  want  integrated 
soiutions  that  are 
customized  in  ways  that 
change  and  evoive 
throughout  the  iife  of  the 
mission  that  they 
support 


Sources:  Turbulence’  as  per  Emery  (1965)  Categories  adapted  from  Prahalad  (2003) 
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Governance  and  Management  Must 
Accommodate  Increasing  Complexity 

•  Number,  type,  and  roles  of  participants  are  increasingly  diverse,  reflecting 
differing  vested  interests  and  sovereign  boundaries 


Scarce  resources  and  the  need  for  concurrent  uses  make  a  single  decision 
authority  increasingly  ineffective  r 


Single  Task 
“System” 


A  single  program  directs 
composition 

— little  potential  for 
conflict 


Single  Enterprise 


A  real  or  virtual  entity 
directs  how  multiple 
entities  collaborate  to 
compose  multiple 
programs 

— resolves  potential 
conflicts  by  imposing 
constraints 


Requires  a 
fundamental  shift 


Multiple  Enterprises 


Multiple  real  or  virtual 
directing  entities  making 
competing  demands  on 
SoS 

— conflict  resolution 
requires  negotiating 
mutual  constraints 
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Understanding  Supply  Complexity  and 
Response  to  Demand 


Increasing  need  for 
context/situation- 
^dependent  response^ 


Response  to  Demand 

User 

Product  Solution  Experience 

Based  Based  Based 


Increasing  diversity 
and  independence 


of  collaborators 


E 

o 

O 


CO 
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This  Presents  a  Double  Challenge 


Challenge  1: 

Collaborating 
effectively  across 
boundaries 


Response  to  Demand 


Product 

Based 


User 

Solution  Experience 


Based 


Based 


CO 


^  Multiple 
(1)  Enterprises 


E 

o 

o 


Single  Task 
System 


Challenge  2: 

Collaborating 
across  boundaries 
to  provide  flexible 
responses  to 
dynamic  and 
unanticipated 
situations 


Source:  Boxer,  Philip,  Morris,  Edwin,  Smith,  Dennis,  &  Anderson,  Bill.  “The  Double  Challenge  in  Engineering  Complex 
Systems  of  Systems.”  Eye  on  Integration,  news@sei  2007,  5. 
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Wildland  Fire  Exampie  and  its  Double  Challenge 


Challenge  1 : 

Responding  to  wildland 
fire  situations  requires 
using  systems  designed 
built,  and  owned  by 
different  organizations 
(e.g.  weather,  land  use, 
sties,  fire  prediction) 


Response  to  Demand 

User 

Solution  Experience 
Based  Based 


Product 

Based 


Challenge  2: 

Wildland  fires  specialists 
(users  of  the  systems) 
need  the  capability  to 
combine  different  systems 
in  varying  ways 
depending  on  the 
particular  characteristics 
of  a  given  fire,  through  the 
changing  life  of  that  fire 
event 
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Discussion  Exercise:  Where  is  Your  Organization 
in  Relation  to  the  Doubie  Chaiienge? 


Response  to  Demand 

User 

Product  Solution  Experience 

Based  Based  Based 


Multiple 

Enterprises 


Single 

Enterprise 


Single  Task 
System 


Where  does  it  need  to  be? 
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Governance  Implications  and  SoS  Types 


Some  experience 
and  practices 


Well  established 
bodies  of 
knowledge  and 
practices  for 
governance, 
management, 
engineering 


Response  to  Demand 

User 

Product  Solution  Experience 

Based  Based  Based 

. . . 

ative  ; 


Multiple  ♦ 

S  Enterprises  ^acknowlgd^^^ 


1^  I 


661 


CO 


. . . 

/  directed  -  \ 
the  comfort 
zone’ 


Single  Task 
System 


Center  driven  H  Edge  driven 


Very  limited 
experience 
and  no  body  of 
knowledge  and 
practices 
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Organizational  Implications  of  the  Double 
Challenge:  Leveraging  the  Galbraith  Star  Modei 


STRATEGY 


STRUCTURE 


Adapted  from  Designing  Compiex  Organizations,  Jay  Galbraith,  Addison-Wesley,  1973. 
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Selected  Organizational  Implications 
Strategy 


Directed 


Positioning  based  on 
variety  of  products  and 
services  being  offered 
to  the  collaboration 
under  traditional  terms 
and  conditions 


Acknowledged 


Positioning  based  on 
predetermined  sets  of 
solutions  for  defined 
customer  sets  that  fit 
the  collaboration  overall 
goals 


Collaborative 


Positioning  based  on 
providing  deep 
customer-oriented 
services  wherever 
needed  throughout  the 
collaboration 
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Selected  Organizational  Implications 
Structure 


Directed 


Hierarchical 
organizational 
structures  that  mimic 
constituent  internal 
structures  are  most 
common 

Some  staff  will  be 
uncomfortable  if  “their” 
organization  al 
framework  is  not  the 
one  being  followed 


Acknowledged 


Matrix  structures  are 
common  at  SoS  (e.g., 
CCBs  &  IPTs) 

More  emphasis  on  the 
roles  people  play  within 
the  collaboration  than 
on  their  job  function 
within  a  single 
organization 


Collaborative 


Significant  governance 
decisions  occur  in  the 
customer  context  via 
distributed  governance 
mechanisms 

“Badgeless” 
environments  where  a 
person’s  organizational 
affiliation  is  subsumed 
to  the  larger 
collaboration  goal 
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Selected  Organizational  Implications 
Processes 


Directed 


A  subset  of  important 
SoS  processes  require 
cross-organizational 
interoperation  (i.e.  CM); 
central  authority 
determines  the  SoS 
process  framework  and 
enforces  adherence 


Acknowledged 


Bilateral  agreements 
between  constituents 
and  the  acknowledged 
SoS  leader  are 
facilitated  by  the  leader, 
but  they  don’t  have 
traditional  authority  to 
enforce;  alternate 
adherence  incentives 
are  needed 


Collaborative 


Combination  of  bilateral 
and  multi-lateral 
process  agreements  for 
processes  considered 
mutually  important  for 
collaboration 
interoperation  are 
required  among 
constituents; 
adherence  cannot  be 
enforced  easily 
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Organizational  Implications — Rewards,  Peopie 


Rewards 


People 


Directed 


Reward  staff  who  sacrifice 
their  traditional  constituent 
practices  to  comply  with 
the  central  authority’s 
governance  and 
management  mechanisms 


Technical  skills  required 
across  multiple  systems; 
management  skills  focus 
on  integration  of  multiple 
organizational  units 


Acknowledged 


Similar  reward  structures  to 
Directed,  plus  ensure  that 
those  building  and 
delivering  multi-system 
solutions  are  motivated  to 
communicate  effectively 
with  external  (to  their 
organization)  SoS 
constituents 


Technical  skills  required  for 
building  solutions  based  on 
multiple  products; 
management  skills  that  are 
needed  include  operating 
across  organizational 
boundaries 


Collaborative 


Include  significant  rewards  for 
furthering  the  goals  of  the 
collaboration,  not  just  those  of 
the  individual  SoS  constituent; 
plus  ensure  that  those 
interacting  closely  with  the 
customers  are  motivated  to 
communicate  effectively  with 
relevant  external  SoS 
constituents 

Ability  to  learn  new  systems 
quickly  is  paramount  technical 
skill;  consulting  skills  are 
prevalent:  negotiation  and 
influencing  skills  are  critical  to 
successful  governance  and 
management 
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Current  State  for  Wildland  Fire  Management 


Software  Engineering  Institute 


SoS  Organizational  Impiications  Tutoriai 

Carne^e  Mellon  October  2009 

OnnO  R/lAlli>m  I 


51 


i>  2009  Carnegie  Mellon  University 


Discussion  Exercise:  Wiidiand  Fire  Management 
As-is  and  Should-Be 


How  do  the  descriptions  of  the  wildland  fire  situation  match  with  the 
descriptions  of  implications  for  Collaborative  SoS? 
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A  Few  Ideas  for  Selected  SoS  Constituent  Roles  -1 


Role 

SoS  Type 

Directed 

Acknowledged 

Collaborative 

CIO 

Be  aware  of  changes  in  the 
demand/collaboration 
environment  that  could  affect 
central  authority  (e.g.,  new 
government  regulations) 

Ensure  your  understanding  of 
the  governance  approaches 
put  into  place  by  the  central 
authority  (  e.g.,  CCB) 

Understand  the  limits  of  the 
decision  making  authority  of 
the  collaboration’s 
acknowledged  leader 

Ensure  staff  is  assigned  to  stay 
close  to  the  customer  context 

Understand  which  decision 
areas  truly  need  to  be  under 
your  control  and  help  to 
ensure  that  appropriate  SoS 
constituents  are  granted 
decision-making  authority  in 
other  areas  (help  ensure 
situational  authority) 

Portfolio 

Manager 

Try  to  ensure  that  the 
incentive  structures  for  your 
individual  programs  don’t 
conflict  with  the  overall  goals 
for  your  portfolio 

Look  for  leverage  points  across 
your  portfolio  that  improve 
flexibility  of  the  overall 
collaboration  solution 

Recognize  that  many  of  your 
portfolio  elements  participate 
in  SoS  collaborations  that 
have  little  to  do  with  your 
portfolio  and  minimize 
governance  approaches  (i.e., 
mandatory  reports  with  only 
one  audience)  that  interfere 
in  those  relationships 
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A  Few  Ideas  for  Selected  SoS  Constituent  Roles  -2 


Role 


SoS  Type 


Program  or 

Project 

Manager 


Directed 


Include  all  stakeholders, 
including  those  in  operational 
environments,  in  design-time 
decision  making 


Acknowledged 


Allocate  sufficient  time  and 
resource  for  participating  in 
interoperating  governance 
approaches  among  collaborators 
(e.g.,  architecture  CCB) 


Collaborative 


Spend  sufficient  time  with 
your  staff  who  are  working 
directly  in  operational 
environments  to 
understand  and  be  able 
to  support  their 
infrastructure/governance 
needs 


Technical 

Manager 

Be  prepared  to  make  changes 
to  your  constituent  system  that 
may  be  suboptimal  but  are 
needed  for  the  SoS  as  a  whole 

Recognize  that  people  working 
with  customer  communities  are 
your  best  source  of  information 
about  engineering  solutions  from 
your  products  and  services 

Look  for  technical 
solutions  that  enable  staff 
on  the  edge  to  more  easily 
respond  to  the  dynamic 
customer  environments  in 
which  they  operate 

Operations 

Manager 

Ensure  that  you  are 
participating  as  actively  as 
possible  in  the  design-time 
decisions  that  will  affect  your 
operation  downstream 

Participate  as  actively  as 
possible  in  the  spectrum  of 
change  control  mechanisms 
offered  by  the  central  authorities 
of  the  collaborations  you’re 
involved  with 

Encourage  and  support 
the  SoS  participants  who 
are  seriously  trying  to 
operate  “from  the  edge” 
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Key  Points  -1 

Suppliers  and  enterprises  are  being  driven  out  of  the  comfort  zone  of 
traditional  systems  engineering  by 

•  Multi-enterprises  systems  of  systems  with  limited  centralized  authority 

•  Suppliers  who  are  taking  greater  responsibility  to  provide  solution-  or 
experience-based  value  for  users 

•  Suppliers  who  are  dealing  with  greater  complexity  associated  with  providing 
experience-based  value  to  users 

How  governance  changes  are  implemented  in  complex  systems  of 
systems  depends  on  the  type  of  SoS  and  the  culture  of  the 
organizations  involved 

Organizational  implications  range  across  multiple  dimensions — People, 
Strategy,  Processes,  Reward  Systems,  and  Structures — governance 
frameworks  and  management  practices  need  to  accommodate 
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Key  Points  -2 


Software  Engineering  Institute 


Era  of  the  end  user/operations  group 
as  second  class  citizens  in  terms  of 
involvement  in  engineering  and  design 
is  over! 

•  In  SoS,  the  operational  situation  is 
increasingly  key  to  composing/ 
recomposing  systems  of  systems  to 
achieve  mission  or  market  objectives 

•  Increasing  volatility  in  operations  means 
that  traditional  requirements  elicitation 
processes  won’t  work — the  operational 
community  is  a  primary  connection  to 
the  evolving  situational  demands 

•  Hierarchical  governance  approaches  do 
not  give  enough  authority  to  staff 
working  “at  the  edge”  so  they  can  be 
effective  in  working  in 
customer/operational  situations 
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Agenda 


Basics  of  Systems  of  Systems 

•  Perspectives  of  SoS  Participants 

•  SoS  Types  and  Characteristics 

Organizational  Implications  of  Systems  of  Systems 

^  Responding  to  Organizational  Implications  in  Systems  of  Systems 

Summary 
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To  Respond  to  SoS  Organizational  Implications 


UNDERSTAND  how  key  aspects  of  our  situation  reflect  SoS  realities 


DETERMINE  CHANGES  that  are  needed  to  our  governance  practices 


PREPARE  TO  ADOPT 


those  new  practices  effectively 


MAKE  AND  MONITOR  CHANGES  to  ensure  that  they  are  effective 
•  Leverage  traditional  organizational  change  approaches 


SEI  SoS  Practice  Governance  and  Acquisition  (SoSP  GA) 
team  supports  some  of  these  activities 
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UNDERSTAND|How  Key  Aspects  of  Situation 
Refiect  SoS  Realities 


Critical  Context  Analysis  (CCA) 

•  Identifies  stakeholders  outside  known  spheres  of  influence  and 
exposes  critical  hidden  relationships  between  organizations  that 
could  have  impacts  on  governance  approaches 


Influence  Mapping  Analysis  (IMA) 


Makes  stakeholder  and  constituent  expectations,  constraints,  and 
boundaries  explicit 

Exposes  the  real  nature  and  the  actual  implications  of  existing 
agreements  among  SoS  constituents 


Strategic  Alternatives  Analysis  (SAA) 

•  Reveals  the  impact  of  candidate  governance  and  acquisition 
approaches  as  a  response  to  potential  changes  in  external 
environment 
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DETERMINE  CHANGES|that  are  Needed  to 
Governance  Practices 


SoS  Focus  Analysis  (SFA) 

•  Indicates  governance  choices  to  achieve  appropriate  balance 
between  technical  and  operational  elements  of  a  SoS  (e.g.,  resource 
allocation,  incentive  policies,  success  criteria) 


Governance  Alignment  Analysis  (GAA) 

•  Identifies  gaps  between  current  and  needed  governance  mechanisms 
and  structures  along  eight  critical  dimensions  (e.g.,  policy, 
collaboration) 


Distributed  Governance  Analysis  (DGA) 

•  Operationalizes  agreements  and  extends  them  by  specifying 
Hi  appropriate  individuals,  actions  to  be  taken,  and  additional  data  (e.g., 
completion  date,  notifications  on  failure) 
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PREPARE  TO  ADOPTi  Those  New  Practices 
Effectively 


Readiness  &  Fit  Analysis  (RFA) 

•  Uncovers  risks  and  creates  mitigation  strategies  that  account  for  social 
realities  of  the  organization  when  adopting  new  governance  practices 
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SoSP  Methods  for  Governance  &  Acquisition 
Optimize  for  One  or  More  SoS  Types 


Method 

Directed 

Acknowledged 

Collaborative 

Critical  Context  Analysis 

X 

X 

Influence  Mapping  Analysis 

X 

X 

Strategic  Alternatives 

Analysis 

X 

X 

X 

SoS  Focus  Analysis 

X 

X 

Governance  Alignment 
Analysis 

X 

X 

Distributed  Governance 
Analysis 

X 

X 

Readiness  &  Fit  Analysis 

X 

X 

X 

Most  methods  can  also  be  used  outside  their  primary  area 
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Example  Use  of  Selected  Governance  & 
Acquisition  Methods:  Wiidland  Fire 

UNDERSTAND:  characterize  who  is  involved  in 
the  broad  SoS  context  and  critical  stakeholders 


Critical  Context  Analysis 


Context(s) 
of  use 


UNDERSTAND:  identify  possible 
future  demands  and  trends 


’♦.  Possible  Future^ 
*•  Demands 


Strategic  Alternatives  Analysis 


Supplier  j 

\  t  * 

\  #  * 

\  #  * 

Community  | 

■ 

lExisting  System^ 

Systems  of 

Operational  / 

Systems 

)ecision-Making/ 

\  &  Methods  \ 

Challenges 

to  MeetCurreny 

Operational  User 
Community 


Demands 


DETERMINE  CHANGES:  establish 
use  of  existing  systems  and  their 
alignment  to  their  context  of  use 

SoS  Focus  Analysis 


DETERMINE  CHANGES:  determine 
needed  balance  of  resources  to 
operationalize  SoS  capabilities 


Governance  Alignment  Analysis 
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Future  Directions  of  SoSP  Work  in  Governance 
&  Acquisition 


Develop  governance  and  acquisition  guidance  for  an  SoS  Practice 
Framework 

•  Analyze  results  from  pilot  uses  for  potential  recommended  practices 

Refine  the  methods  for  specific  problems  of  different  SoS  types 

•  Identify  standard  profiles  to  predict  governance  gaps  common  to  different 
SoS  situations 

Pilot  SoSP  methods  (e.g.,  Critical  Context  Analysis)  in  situations  with 
different  characteristics  than  previous  pilots 

•  Expand  our  understanding  of  the  applicable  scope  and  scale  for  the  methods 
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Agenda 


Basics  of  Systems  of  Systems 

•  Perspectives  of  SoS  Participants 

•  SoS  Types  and  Characteristics 

Organizational  Implications  of  Systems  of  Systems 
Responding  to  Organizational  Implications  in  Systems  of  Systems 

^  Summary 
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Key  Takeaways 


The  shift  in  how  systems  are  built,  deployed,  and  used  has  implications 
for  organizations 

•  Systems  are  rarely  standalone;  rather  they  are  networks  of  socio-technical 
systems  (of  systems) 

New  bases  for  making  organizational  decisions  are  needed 

•  An  SoS  can  be  characterized  by  relationships  of  constituent  systems, 
stakeholders,  and  goals  and  purpose — all  within  a  particular  context  of  use 

•  Understanding  the  type  of  SoS  context  you  are  in  can  help  frame  decisions 

New  governance  structures  and  approaches  are  needed  as  capabilities 
of  systems  of  systems  cross  sovereign  enterprise  boundaries 

•  Collaboration  of  constituent  systems  and  stakeholders  is  required  where  a 
central  authority  realistically  does  not  exist 

SEI  is  adapting  and  packaging  methods  to  facilitate  the  analysis  of 
essential  relationships  across  SoS  types,  particularly  for  Directed, 
Acknowledged,  and  Collaborative 
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